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METHOD AND APPARATUS FOR REDUCING LOGIC ACTIVITY IN A 
5 MICROPROCESSOR 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention relates generally to a method and apparatus for 
1 0 reducing logic activity in a microprocessor, and more particularly pertains to a method 
and apparatus for reducing logic activity in a microprocessor which leverages off the 
variations in effective bit-widths of operations in an apphcation in controlling the total 
energy/power consumed during a workload execution. Energy or power consumed 
during a workload's execution in a microprocessor is partly due to the bit transitions or 
1 5 logic activity experienced in the course of processing. Hence, the larger the number of 
bits that have to transition during any one operation, the higher the activity levels and 
the likelihood of more energy being consumed. 

2. Discussion of the Prior Art 

The datapath for today's microprocessors is getting larger, particularly 
20 to cover very large memory address space. Currently, the 32-bit datapath is 

commonplace, and 64-bits is becoming more widespread. However, a closer look at 
the effective operation width in typical applications reveals that as much as 70% of 
instructions in some applications can be executed with an 8-bit wide functional unit. 
This means that the typical microprocessor today is unnecessarily executing longer 
25 operations, causing unnecessary bit transitions, and ultimately consuming more energy 
than is really necessary for accurate program execution. 

SUMMARY OF THE INVENTION 

Accordingly, it is a primary object of the present invention to provide a 
method and apparatus for reducing logic activity in a microprocessor which examines 
30 every instruction before it is executed and determines in advance the minimum 



YOR920000809 USl 




appropriate datapath width (in byte or half-word quantities) necessary to accurately 
execute the operation. 

Achieving this requires two major enhancements to a traditional 
microprocessor pipeline. First, extra logic (potentially an extra pipeline stage for 
5 determining an operation's effective bit width -the WD width determination logic) is 
introduced between the Decode and Execution stages. Second, the traditional 
Execution stage architecture (consisting of the register file RF and the arithmetic 
logical unit ALU), instead of being organized as one contiguous unit, is organized as a 
collection of multiple slices, where a slice can be of an 8-bit (a byte) or a 16-bit 
10 (double byte) granularity. Each slice in this case can operate independently of every 
other slice, and consists of a portion of the register file, functional unit and cache 
memory. Concatenating a multiple number of these sUces together creates a required 
Ml width processor. These slices work either all in parallel when a fiiU-width 
; I operation is execiated, or only the lowermost slice(s) is (are) (minimum required 

y1 15 number) enabled for the case of narrow-width operations. Slices are enabled on a 

jl cycle-by-cycle basis by the width determination logic using information on RF value 

widths and signs which are stored for each register value. The WD logic achieves the 
Q enablement of various slices through the use of clock gating. 

ij^ The process of utilizing the minimum appropriate datapath bits per 

W 20 instruction execution enables a reduction in the logic activity of a processor so that 

1 ;4 dynamic power consumption can be reduced, with little or no performance 

degradation. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The foregoing objects and advantages of the present invention for a 
25 method and apparatus for reducing logic activity in a microprocessor may be more 

readily understood by one skilled in the art with references being had to the following 
detailed description of several preferred embodiments thereof, taken in conjunction 
with the accompanying drawings wherein like elements are designated by similar 
related reference numerals throughout the several views in which: 
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Figure 1 is a block diagram of a simple multistage microprocessor 
pipeline structure for a traditional microprocessor design. 

Figure 2 is a block diagram of a microprocessor pipeline structure of 
the present invention incorporating width determination (WD) Logic and bit width 
5 slices consisting of 4 slices, where each slice is of 8-bit granularity. 

Figure 3 illustrates an appropriate example of the definition of the 
effective operation width. 

Figure 4 illustrates graphs on the potential for varying bit- width 
computing, and illustrates the average operation width distributions of SPECInt2000 
1 0 and Mediabench. 

Figure 5 illustrates another embodiment of the subject invention having 
a varying bit width architecture, and shows a pipeline microprocessor structure 
:J consisting of 3 sHces, where 2 slices are of width 8-bits and 1 sUce is of width 16-bits. 

Figure 6 is a logic flow diagram of width determination for operations 
111 15 of the ALU (arithmetic logical unit). 

' S Figure 7 illustrates a width determination process for operands 

— comprising source operands Srci and Src2 and a result register Dst. 

Q Figure 8 illustrates WD (width determination) logic expanded to show 

Lli 

overflow detection. 

20 Figure 9 illustrates logic development for overflow detection in 

1^4 addition operations using 2-bit tags. 

Figure 10 illustrates one embodiment of a 2-bit overflow logic 

determination. 

Figure 1 1 illustrates one embodiment for performing overflow 
25 determination in parallel across two widths. 

Figure 12 is a logic flow of data writeback following ALU operation 
execution and completion. 

Figure 13 illustrates one embodiment for determining the width of a 

result value. 
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DETAILED DESCRIPTION OF THE DRAWINGS 

Figure 1 is a block diagram of a simple multistage microprocessor 
pipeline structure for a traditional microprocessor design. To start an instruction 
execution, the instruction is first fetched from an instruction cache 101 and loaded into 
5 an instruction buffer 1 02. The instruction is then decoded by a decoder 1 05 for the 
operation, and the corresponding register values are read from a register file 150 and 
are input to an arithmetic logical unit 160 where the actual execution takes place, the 
output of which is stored back in a register file 150 and may be subsequently stored 
into a cache memory 170. 
10 Figure 2 is a block diagram of a first embodiment of a microprocessor 

pipeline structure of the present invention incorporating width determination (WD) 
Logic 220 and bit width sHces consisting of 4 sUces 230, wherein a slice 230 is of 8- 
bit granularity. Each sUce 230 consists of a portion of the register file RF 250, a 
;'=5| portion of the ALU 260, and a portion of the cache memory 270. In Figure 2, the 

111 1 5 lowermost or least significant sUce is illustrated on the right, and the uppermost or 

I most significant slice is illustrated on the left, with a data carry operation from a lesser 

^"'^ significant slice to a more significant slice. The concatenation of these 4 slices 230 

Q creates a fiiU-width processor, as required by the processor architecture. 

The slices shown here work either all in parallel when a fiiU-width 
'Jj 20 operation is executed, or only the lowermost slice(s) is (are) (minimum required 

number) enabled if the operation width is determined to be narrow. Slices are enabled 
on a cycle-by-cycle basis by the width detection (WD) logic 220 which uses 
information about the length of the operands kept in an RFtags module 210. The 
RFtags module 210 can be a table that stores value bit information (see 720 in Figure 
25 7 and the detailed explanation thereof) about all operands in the register file 250. This 
value bit information is referred to as bitmask, and is explained in detail with reference 
to Figure 7. All sorts of value bit information may be kept for a register operand. In 
one embodiment illustrated at the bottom of Figure 7, the bitmask keeps the sign in 
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one bit, the register data width -in bytes of the operand value in two bits, and the 
leading two bits of each of the first two bytes of the operand value. 

The cache tags 280 comprise addresses of the cache memory to write to 
and to read from, and the width tags 28 1 comprise the width of data stored in each 
memory address. 

In Figure 2, control signals flow from the WD logic 220 directly to 
enable dataflow and computation in the slices 230 appropriately. Data layout in the 
cache 270 is organized as follows. A word of data consists of 4 bytes. In this cache 
data layout 270, a word is divided into a most significant byte 0 which resides in the 
first leftmost sHce, see 270, a second and third lesser significant byte 1,2 which is 
entered into the respective second and third slices, and a least significant byte 3 which 
is entered into the right-most sUce, and etc. for succeeding bytes, 4, 5 . . . 1 5 . . .n. Data 
overflow or carry proceeds from the least significant slice to the most significant slice. 

The determination of the width of an operation is performed after the 
decoder stage 205 in the pipeline (as shown in Figure 2), and suitable control bits are 
propagated with the data through the pipehne for enabling the various stages as 
needed. The output of the decoder 205 labeled 3 indicates two source and one 
destination registers, and the output of the decoder 205 labeled op indicates the 
instruction operation code (opcode). The process determines the appropriate width for 
an operation, and propagates this information down the pipe (from register/memory 
read through register write-back or cache memory store) (load data from cache 
memory to register if necessary, from register to ALU, perform ALU operation, 
transfer data from ALU to register, and finally store from register to cache memory) to 
reduce process logic activity. 

The effective operation width is defined as the minimum datapath 
width actually required to perform an operation and achieve the correct result for the 
operation. This process may include the possible need to copy the upper portions of 
one of the operands into the result register or a sign extending the result of the 
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operation into the upper portions of the result register when at least one of the. 
operands for the operation is negative. 

Figure 3 illustrates an appropriate example of the definition of the 
effective operation width. This example adds 2 positive numbers of thirty two (32) bit 
5 length 3 1 0 and eight (8) bit length 320 respectively, shown in a hexadecimal format. 
By the definition, this operation can be correctly carried out by adding only the lower 
eight bits and copying the upper portion of the first operand into the result 330. 
Instead of a 32-bit operation therefor, only an 8-bit operation is performed. 

From the foregoing definition of the effective operation width, Figure 4 

10 illustrates graphs on the potential for varying bit- width computing, and illustrates the 
average operation width distributions of the SPECInt2000 and Mediabench. These 
graphs show that the average embedded application instruction is skewed in the 
direction of narrow width words, creating the impetus for narrow bit- width computing 
pursuant to the present invention. 

1 5 To help in the effective operation width determination process, the RF 

Tags module 210, 510, 710, shown in Figures 2, 5 and 7, stores the sign and width of 
each operand stored in the Register File. In addition, these tags also keep track of a 
few (one or two, for example) leading bits of every byte of each RF value. These 
leading bits are particularly important for deciding the operation length. In particular, 

20 the leading bits for the two input operands to an operation can be examined for 

"possible overflow" detection. The actual number of bits can be arrived at based on a 
tradeoff between overflow detection accuracy and the number of bits the designer is 
willing to store. As explained below, the sign of a register value can either be stored 
in the RFtags module 210 or as part of the register value itself. 

25 The RFtags module is accessed after an instruction is decoded; the 

contents of the RFtags module and the instruction opcode are used to determine the 
number of slices required for executing the corresponding instruction, and those slices 
are enabled in subsequent cycles, in pipelined fashion. In particular, for the case of 
narrow operations whose result is saved in a register which already contains a narrow 
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operand, it is possible to save only the significant part without accessing the upper 
portion of the register if its contents are already set to the target value (for example, all 
zeroes). 

The approach for a-priori width determination also requires a 
determination of the action needed to generate the upper portion of the result. 
Specifically, the following needs to be determined prior to executing a narrow 
operation: the width of the operands; the possibility of arithmetic overflow in the 
narrow operation; and the upper portion of the complete result. 

An analysis on the present invention has revealed that the fi:equency of 
arithmetic overflow in narrow operations is quite small, so that the design of a 
processor can be optimized for the case when no overflow occurs. For these purposes, 
a mechanism is applied that determines the likelihood of an arithmetic overflow being 
generated fi*om a narrow operation by examining the leading bit(s) of the operands 
involved, which are available in the RFtags. This mechanism generates three cases. 

Case 1: No overflow is guaranteed, thus the effective operation width is 
determined by the width of the narrow operands. 

Case 2: Overflow is guaranteed, thus the effective operation width must 
be one byte larger than the width of the narrow operands. As a result, no overflow is 
guaranteed. 

Case 3: Overflow condition is possible but not certain, corresponding 
to the case wherein a carry into the bits examined will be propagated as a carry out. 
This situation can be handled by either regarding the possible overflow as "always 
overflow" or "no overflow." If "always overflow," then extra activity occurs for those 
cases when there is no actual overflow, whereas "no overflow" requires a mechanism 
that detects whether an overflow actually occurred and then re-executes the operation 
with one extra byte of width. The case 3 approach has the potential of leading to less 
activity, but at the cost of some complexity and performance degradation. 

To determine the upper portion of the result, it is assumed that narrow 
operations are known a-priori not to generate arithmetic overflow, and rely on either 
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of the schemes outHned above to deal with the cases when overflow may occur. For 
simpUcity, the discussion is focused on the requirements for the implementation of 
addition. The determination of the upper portion of the complete result depends on the 
mechanism used to deal with the values contained in the narrow operands. Generally, 
5 there are 3 possible scenarios to arrive at a result for an operation: simple, simple with 
sign extension (1 -biased), and quasi-simple. 

simple: operands equal width, both positive; upper portion of the 
complete result full or all Os. 

simple with sign-extension (1-biased): operands can be the same or 
10 varying widths, at least one operand negative; the upper portion of the result is the 
sign extension of the computation. 

quasi-simple: one operand narrow and one operand wide, both 
positive; the upper portion of the complete result is a copy of the upper portion of the 
wide operand. 

IJI 1 5 Figure 5 illustrates a second embodiment of the present invention 

! J having a varying bit width architecture, and shows a pipeline microprocessor structure 

consisting of 3 shces, where 2 shoes 540 are of width 8-bits and 1 sUce 530 is of width 

O 1 6-bits. The embodiment here illustrates that an implementation can be of varying 

Lfl 

number of slices where the slices can be of varying bit widths as well. Again, each 
% 20 shoe consists of a portion of the register file RF 550, the ALU 560, and a portion of 

H the cache memory 570. 

The concatenation of these 3 slices creates a full-width processor, as 
required by the processor architecture. The slices work either all in parallel when a 
full-width operation is executed, or only the lowermost slice(s) is(are) enabled if the 
25 operation width is determined to be narrow. Slices are enabled on a cycle-by-cycle 
basis by the width detection (WD) logic 520 which uses information about the width 
of the operands kept in the RFtags module 510. This embodiment can perform a 1 
byte (8-bit), 2 byte (16 bits) or 4 byte (32 bits) computation per enablement, and the 
explanation focuses on ALU operations, with special emphasis on addition. 
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To start an instruction execution, the instruction is first fetched from 
the instruction cache 501 and loaded into the instruction buffer 502. The instruction is 
then decoded by decoder 505 for the operation and the targeted input and output 
registers. At this point, a varying bit processing methodology takes over as illustrated 

5 in the logic flow diagram of Figure 6 and the supporting explanations of Figures 7-13. 
The RFtags module (210, 510, 710) is a table that stores value bit information (see 
stored value 720 in Figure 7) about all operands in register files. This value bit 
information is referred to as bitmask 720. All sorts of value bit information may be 
kept for a register operand. In this implementation shown at the bottom of Figure 7, 

1 0 the bitmask has one bit on the sign, two bits on the register data width in bytes of the 
operand value, and four bits on the two leading (most significant) bits of each of the 
first two bytes of the register operand. 

''"".^ 

[| In determining and storing the width of an operand into the RFtags 

|| module, a negative number is terminated by its first 1 bit in the MSB (most significant 

[1 . 15 bit) portion that forms part of it being negative, i.e. beyond its terminating 0. A 

I positive number on the other hand terminates by its most significant 1 . 

Figure 6 is a logic flow diagram of width determination WD for 

3 operations of the ALU (arithmetic logical unit). 

11 

^ Figure 7 illustrates a width determination WD process for operands 

y 20 comprising source operands Srci and Src2 and a result register Dst, as determined by 

the RFtags module 7 1 0 and WD logic 730. 

Figure 8 illustrates the width determination WD logic expanded to 
show overflow detection, as explained in greater detail hereinbelow. 

Referring to Figures 6, 7 and 8, a lookup of the RFtags table is 
25 performed for the 2 source operands Srcl, Src2 and the result register Dst, as shown at 
71 0 in Figure 7. Considering the operation of the instruction, the bitmask information 
about the value widths of the 2 source operands (Srcl, Src2) are compared at 610, 
Figure 6, and in the WD logic, as shown at 730, Figure 7. Referring to Figure 6, the 
narrower of Srcl and Src2 is selected as the interim EW (effective operation widtii) at 
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620. Then the kind of operation is checked at 630. If the operation is a logic 
operation at 630, then the interim EW is the final EW at 680. This is because a logic 
operation, such as an AND or OR operation, by its very nature, does not result in an 
overflow. Whereas, if the operation is an arithmetic operation, such as an addition, 
5 then there is the possibility that an overflow can occur. In that case the next step is to 
check for an overflow at 640 and 650, Figure 6, and at 820, Figure 8. 

The leading 2 bits of the narrower operand are compared against the 
matching bits of the other operand at 640. In the case where both operands are of the 
same width, the leading 2 bits of both operands are compared against each other. If it 
1 0 is determined that overflow is not possible, then the interim EW is the final EW at 
680, However, if there is an overflow, then EW is EW + 1 at 660. In the case where 
EW is 2 (for a 16 bit computation), for the embodiment of Figure 5, this addition 

CI 

;J should take EW to a 4 (for a 32 bit computation) since the implementation of Figure 5 

skips a 24-bit computation). The new EW is checked to determine if it is less thaa or 
U1 15 equal to 2 (i.e. 2 bytes) at 670. If the new EW turns out to be less than or equal to 2, 

,11 then return to 640, where the leading 2 bits of the EW "operand" is again compared 

^""^ against the matching 2 bits of the other operand for possible overflow at 650. 

0 However, if the EW is larger than 2 at 670, then the final EW is the new EW. The 

final EW is next compared against the width of the result register Dst at 690. If EW is 
20 less than the width of Dst at 690, then quasi-simple work is performed to fill or reset 
1^4 the upper portion of Dst. No quasi-simple work otherwise. 

Figure 9 illustrates a truth table for logic development for width 
determination WD in addition operations using 2-bit tags, wherein bit tag XaXb are 
the two most significant (leading) bits of the WD operand (as stored in bitmask 720), 
25 and can assume one of the four values shown at the left side of the table at the top of 
Figure 9. Similarly, YaYb are the two most significant matching bits of the second 
operand (as stored in bitmask 720), and can assume one of the four values shown at 
the top of the table. The blank white blocks in the table indicate that there can be no 
overflow for the XaXb and YaYb bit patterns intersecting at those boxes, the white 
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blocks with a 1 therein indicate that there definitely will be an overflow, and the 
shaded blocks of the table indicate that there is a possibility of an overflow. 

It should be noted that a 2-bit tag choice for overflow determination 
here is almost arbitrary, and an appropriate choice may be made after weighing the 
5 tradeoff between logic complexity and overflow determination accuracy based on the 
length of the bits tag considered. For example, for a 1-bit tag, there is less logic 
complexity and higher overflow mispredictions. In such a case, the whole system can 
be designed around poor overflow mispredictions such that an operation may be re- 
executed with a wider bit-width after an actual overflow occurs. The consequence in 
1 0 that case will be performance degradation. The other extreme is to examine and 
compare all the bits in both source operands. In such a case, overflow prediction 
accuracy will be perfect, however, the logic complexity involved may render the 
ij^g whole varying bit-width approach useless. 

|"JI An overflow for an addition operation can be determined by the logic 

y1 1 5 equation Fqverflow at the bottom of Figure 9 which has five terms separated by a plus 

',! 

i U< 

,13 (+), which indicates that the five terms are logically ORed. Each of the five terms 

'7 contains a period (.), which indicates that the two bits of the term are logically 

0 ANDed. 

IJI 

jl| Accordingly, the equation F overflow can be implemented by the logic 

Jfi 20 circuit of Figure 1 0 which comprises 5 AND gates 1 00 having the illustrated inputs 

H fix)m Xa, Xb, Ya, Yb to form the five terms of the equation Foverflow, the outputs of 

which are ORed by OR gate 102 to form the overflow logic circuit 104, which 
determines Foverflow- 

Figure 8 indicates the WD determination expanded to show overflow 
25 detection. The widths of operands 1 and 2 are input to an Initial Width Selector 810 
corresponding to blocks 610,620 of Figure 6, which outputs a 2 bit signal xy. If xy is 
01, the initial operation width is 8 bits (1 byte) long. If xy is 10, the operation width is 
16 bits (2 bytes) long. Otherwise, that is for xy being 00 or 1 1, the operation width is 
0 bits or the fiill 32 bits, respectively. An Overflow Detector 820, discussed further in 
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Figure 11, outputs an overflow signal z to a Final Width Decider 830 which modifies 
the initial selection xy to the final width determination x"y" based on the output z of 
the Overflow Detector 820. 

Figure 1 1 describes an expanded form of Overflow Detector 820. In 
5 this overflow detector designed to specifically fit the embodiment of the invention 
presented in Figure 5, two Overflow Logic Circuits 104 are placed in parallel to catch 
possible overflows flowing past the 8 bits boundary or the 16 bits boundary. As 
shown, the corresponding two most significant bits of the two operands for the 8 bit 
boundary (XaXb, YaYb) feed into one Overflow Logic Circuit 104 whose output is 
10 ki . Likewise, the two most significant bits of the two operands for the 1 6 bit 

boundary (labeled XcXd, YcYd) feed into another Overflow Logic Circuit 104 whose 
output is k3. A third signal k2 is tied to 0. All three signals k^, k2, k3 feed into a 3-to- 

1 Selector 1 10, which selects among them based upon the output xy of the Initial 
Width Selector 810, and outputs a final value z to the Final Width Decider 820, as 

1 5 illustrated in Figure 8. This logic provides a simple and efficient way of covering 
overflows in the embodiment shown in Figure 5, which has both an 8 bit wide slice 
and a 16 bit wide slice. 

Following the WD width determination stage, control signals flow fi*om 
the WD logic 220 or 520 directly to enable dataflow and computation in the slices 

20 230, Figure 2, or 530, 540, Figure 5, appropriately. The actual slices enabled per each 
cycle depends on the "width of the operation" determined. Enabling and disabling is 
accomplished by the use of clock gating, where enabUng means that clock signals 
allow data to proceed into and through a slice. Likewise, disabling implies that clock 
signals block the flow of data into and through a slice. 

25 Figure 12 is a logic flow diagram showing the flow of data following 

execution and completion of an ALU operation. This follows right after a set of 
slice(s) are enabled and the actual ALU computation is complete. At this stage, at 120 
the width of the actual value of the Result is determined. The value width 
determination of the Result is further explained in Figure 13. After determining the 
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width of the Result, at 121 a 7-bit bitmask 720 is formed for the Result by combining 
its sign bit, value width and the leading 2 bits for its byte one and byte two. At 122 
the actual value of the Result is then written to the destination register Dst in the 
register file RF 250,550. At 123 the signal fi-om the WD stage for Q-Simple Work is 
5 examined for quasi-simple work or sign extension work. 

If the Q-Simple Work signals are negative 123, at 124 the upper portion 
of the destination register Dst beyond the width of Result is reset, and at 128 the 
formed bitmask 720 is written into the corresponding entry in RFTags (210,510,710). 

On the other hand, if the Q-Simple Work signals are positive at 123, at 
10 125 a further check is made for a sign extension. If the sign extension is true, at 126 
the upper portion of the destination register Dst beyond the width of Result is set, and 
at 128 the formed bitmask 720 is written into the corresponding entry in RFTags 
(210,510,710). If the sign extension is false at 125, at 127 the upper portion of the 
wider source register Src beyond the width of Result is copied into the upper portion 
15 of the destination register Dst 127, and at 128 the formed bitmask 720 is written into 
the corresponding entry in RFTags (210,510,710). 

Figure 13 is a logic flow diagram that illustrates how to determine the 
width of an operand or a result value. This illustration is shovm for up to 32-bit wide 
values. Even though the comparisons 131, 133, 135, and 137 are illustrated serially in 
20 Figure 13, they can also be carried out in parallel. 

While several embodiments and variations of the present invention for 
a method and apparatus for reducing logic activity in a microprocessor are described 
in detail herein, it should be apparent that the disclosure and teachings of the present 
invention will suggest many alternative designs to those skilled in the art. 
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